Tinker with LLMs in the privacy of your own home using Llama.cpp

Everything you need to know to build, run, serve, optimize and quantize models on your PC Hands on Training large language models (LLMs) may require millions or even billion of dollars of infrastructure, but the fruits of that labor are often more accessible than you might think. Many recent releases, including Alibaba's Qwen 3 and OpenAI's gpt-oss, can run on even modest PC hardware.